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Abstract 

We study the matrices Qf. of in-forests of a weighted digraph F and their connections 
with the Laplacian matrix L of F. The {i,j) entry of Qf. is the total weight of spanning 
converging forests (m-forests) with k arcs such that i belongs to a tree rooted at j. The 
forest matrices, Qf., can be calculated recursively and expressed by polynomials in the 
Laplacian matrix; they provide representations for the generalized inverses, the powers, 
and some eigenvectors of L. The normalized in-forest matrices are row stochastic; 
the normalized matrix of maximum in-forests is the eigenprojection of the Laplacian 
matrix, which provides an immediate proof of the Markov chain tree theorem. A source 
of these results is the fact that matrices Qf. are the matrix coefficients in the polynomial 
expansion of adj(A/ + L). Thereby they are precisely Faddeev's matrices for — L. 
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1 Introduction 

According to the matrix-tree theorem, the cofactor of the Laplacian matrix of a weighted 
digraph equals the total weight of spanning converging trees rooted at vertex i of the digraph. 

Fiedler and Sedlacek proved that the principal minor of the Laplacian matrix resulting 
by the removal of the rows and columns indexed by a set J is equal to the total weight of 
in-forests with \J\ trees rooted at the vertices of J. 

These results are generalized by the all minors matrix tree theorem |17II10| (see also '53') 
which expresses arbitrary minors of the Laplacian matrix in terms of in-forests of the digraph. 

We study the matrices, Qj., of a digraph's in-forests: the (i, j) entry of Q^. is the total 
weight of in-forcsts with k arcs where i belongs to a tree converging to j. In this paper, 
we show that the forest matrices can be recursively calculated and represented by simple 
polynomials in the Laplacian matrix L; in turn, the powers of L are linear combinations 
of Q^.'s. Further, we demonstrate that the forest matrices are useful to interpret a number 
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of expressions that involve the Laplacian matrix, including those of the group and Moore- 
Penrose inverses, and some eigenvectors. Of special interest is the normalized matrix J of 
maximum in- forests of a digraph previously used |42[I43| to represent the long run transition 
probabilities of Markov chains. We prove that J is the eigenprojection of the Laplacian 
matrix corresponding to the eigenvalue and study some properties of J. 

A seminal result that enables one to give short algebraic proofs to these representations 
is the fact that matrices Q^, coincide with the matrix coefficients in the polynomial form of 
adj(A/ + L): 

n-l 

adj(A/ + L)-^Q„_,_lA^ 

fe=0 

where adj A is the transposed matrix of cofactors of A. This expansion is a corollary to the 
parametric matrix-forest theorem ^ which expresses the entries of (/ + tL)^^, r G M in 
terms of in-forests. 

All results of this paper are applicable to unweighted digraphs (by taking all weights 
equal to one) and undirected graphs (by considering symmetric digraphs). 

The paper is organized as follows. After the notation section, we briefly survey the ma- 
jor known results on the minors of the Laplacian (Kirchhoff ) matrix of a weighted digraph 
(Section EJ, give a new proof to the matrix- forest theorem for digraphs (Section 0J, present 
a recursive method for calculating the forest matrices (Sectional), establish polynomial rep- 
resentations of the forest matrices (Sections EJ, study the normalized matrix J of maximum 
in-forests (Section [7|), consider L and J as linear transformations and show that J is the 
eigenprojection of L, which yields the Markov chain tree theorem (Section |SI), and finally, 
express the generalized inverses of L in terms of the forest matrices (Sectional). 

2 Notation 

2.1 Graph definitions 

For graph terminology, we mainly follow . Suppose that F is a weighted digraph without 
loops, V{T) = {1, . . . , n}, 71 > 1, is its set of vertices and E{r) its set of arcs. The weights 
of all arcs are strictly positive. Let W — (w^j) be the matrix of arc weights of F. Its {i,j) 
entry, w^j, equals zero iff there is no arc from vertex i to vertex j in F. If F' is a subgraph 
of F, then the weight of F', w(F'), is the product of the weights of all its arcs; if F' does 
not contain arcs, then w(F') — 1. The weight of a nonempty set of digraphs Q is defined as 
follows: 

w{g) = ^(^) = 0- (1) 

Heg 

A spanning subgraph of F is a subgraph of F with vertex set V{T). The outdegree of 
vertex v is the number of arcs that come from v. A converging tree is a weakly connected 
(i.e., its corresponding undirected graph is connected) digraph in which one vertex, called 
the root, has outdegree zero and the remaining vertices have outdegree one. 
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A converging tree is said to converge to its root. Spanning converging trees are sometimes 
called in-arhorescences. A converging forest is a digraph all of whose weak components (i.e., 
maximal weakly connected subgraphs) are converging trees. The roots of these trees are the 
roots of the converging forest. 

Definition 1. An in-forest is a spanning converging forest. 

Definition 2. An in- forest _F of a digraph T is called a maximum in- forest of F if F has no 
in-forest with a greater number of arcs than in F. 

Out-forests which diverge from their roots and maximum out-forests are defined in the 
same manner. In this paper, we deal with in-forests, but a parallel theory can be developed 
for out-forests. 

The notion of maximum in-forest of a digraph generalizes the concept of spanning con- 
verging tree (in-arborescence) . If spanning converging trees of a digraph exist, they coincide 
with maximum in-forests; otherwise maximum in-forests inherit some of their properties. 
These properties were studied in 1 . 

It is easily seen that every maximum in-forest of F has the minimum possible number 
of converging trees; we call this number the in- forest dimension of F and denoted it by d. 
The number of arcs in any maximum in-forest is obviously n — d; in general, the number of 
disjoint trees in a spanning forest with k arcs is n — fc. 

By T^*{T) = T^* and J^j^*(F) = T^* we denote the set of all in-forests of F and the 
set of all in-forests of F with k arcs, respectively; T^T'*'' will designate the set of all in-forests 
with fc arcs where i belongs to a tree converging to j; j:^'^*^ — U)!~q T^T'*'' is the set of such 
in-forests with any number of arcs. The notation will be used for the set of in-forests 
that consist of fc trees. The — sign relates to in-forests; the corresponding notation for 
out-forests is jr*~*, etc. 

Let 

= H:Fk*). fc = o,i,..., (2) 

n — d 

a = = (3) 

fe=o 

By |(2Jl and O ; '''fc = whenever k > n ~ d, and ctq = 1 . 
We will also consider the parametric value 

n — d 
k=0 

which is the total weight of in-forests in F provided that all arc weights are multiplied by r. 
Let 

fc 

s^. = ^aj, k^O,...,n-d (5) 
be the total weight of in-forests of F with at most k arcs. Then, by definition, s„_fj = cr. 
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Finally, 



k 



{t) ^^ajT\ k^O,...,n-d, 



(6) 



whence s^_^{t) = CT(r). 

2.2 Matrix definitions 

For any nxn matrix A, let A{2 \ J'), where Z, J' C {1, . . . , n}, be the submatrix of A obtained 
by the removal of the rows indexed by X and the columns indexed by J'. For a complex 
matrix A, A* is the conjugate transpose (Hermitian adjoint) and A'^ the transpose of A. 

The Laplacian (or row Laplacian) matrix of a weighted digraph F is the nxn matrix 
L ^ L(r) = ) with entries = -w,,, when j ^ i and iii = -Yl, ^ik^ j = 1, ■ • • , The 



column Laplacian matrix L' — L'iV) = {^'ij) differs from L by the diagonal only: = — 
when j ^ i and = — ^'fei' ~ 1, . . . , n. The Kirchhojf (or roiw Kirchhojf) matrix 



|f)5l is X = L'^; the column Kirchhoff mairbi is if' — . These four singular matrices are 
generalizations of the Laplacian (Kirchhoff) matrix of an undirected graph. In what follows, 
we deal with the Laplacian matrix L{T) and reformulate for it some results originally obtained 
for the other matrices. 

Throughout let F be a fixed digraph. Consider the matrices 



k^i 



Qk^iq^j). A:-0,1,..., 



of in-forests of F with k arcs: the entries of Qj. are 




(7) 




(8) 



with entries q^^ = w{T'^^*^). 

We will also consider the normalized matrices of forests: 

Jk = ^k^Qk^ k = 0,...,n-d, 



(9) 



J = (j-^Q, 



(10) 



and the parametric matrices 



n — d 




(11) 



J(r) 



a-\T)Q{T), T>0, 



(12) 
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where cr^, cr, and a{T) are defined by ©-Q- 

The normalized matrix of maximum in-forests J„_^ will be also denoted by J: 

In the case of undirected graphs, the entries of J are the same within every connected 
component. In the directed case, this matrix possesses nontrivial properties determined by 
the properties of maximum in-forests, cf. 0. 

Proposition 1. The matrices Jj^, k = 0, . . . ,n — d, J, and J{t) are row stochastic. 

Proof of Proposition^ Every row sum of Q^,, A; = 0, . . . , n — d, is ctj.. Indeed, for every 
z = 1, . . . , n, we have 

n n n 

In the (*) passage, we used the fact that JF^.^*"'^ n t]^*'''^ — whenever j\ ^ . Thus, the 
nonnegative matrices J^, = cr'^^Q^. are row stochastic. Now the stochasticity of J and J(t) 
follows from their definitions. □ 

The aim of this paper is to interpret, in terms of the forest matrices, a number of expres- 
sions that involve the Laplacian matrix as well as to provide polynomial expressions for the 
forest matrices themselves. 

3 Preliminaries 

This section briefly surveys some known results on the minors of a digraph's Laplacian 
matrix. 

The oldest result of this kind is the matrix-tree theorem by Tutte |64[ I65| . although some 
authors (e.g., jJU]; cf |H21) trace it back to Sylvester [SS] and its proof to Borchardt 

Theorem 1. For every i,j G V{r), = w{'2 holds, where is the cofactor of the 
{i,j) entry of L and 1 *** is the set of all spanning trees converging to i in T. 

As stated in ^J, "This small formula opens a world of opportunities." 

Tutte [HSI formulated this theorem for the diagonal cofactors of the KirchhofF matrix. 
A version that involves all cofactors of the Laplacian and the column Laplacian matrices can 
be found in PU]. We do not describe multiple analogues of the matrix-tree theorem here. 

By definition, L has the form L = D ~ W, where W is the nonnegative matrix of arc 
weights and D is the diagonal matrix ensuring the zero row sums of L. Therefore, by 
Gersgorin's theorem, the real part of each nonzero eigenvalue of L is positive. Thus, L 
is a singular M-matrix (see, e.g., Theorem 4.6 in Chapter 6]). One of the consequences 
is that all the principal minors of L are nonnegative. Fiedler and Sedlacek [21] obtained an 
interpretation of all principal minors of the Laplacian matrix in terms of spanning forests: 
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Theorem 2. For any J C {1, . . . ,n}, detL{J \ J) = w{j^^*^) holds, where T^*^ is the 
set of in-forests for which J is the set of roots. 

Later this theorem was formulated and proved in Its special case with undirected 
graphs and = 2 was discovered and employed earlier in the theory of electrical networks 
(see, e.g., [HSl). Fiedler and Sedlacek stated their result for the column Laplacian matrix 
and out-forests. Generally, to get interpretations for the minors of the column Laplacian 
matrix L'{T), it suffices to observe that for the digraph obtained from F by the reversal of all 
arcs, the Laplacian matrix coincides with K(T) = i'^(F) and the in-forests are in a weight 
preserving correspondence with the out-forests of F. 

Let 

n 

(p(A)=det(A/ + L) = ^c„_,A'= (13) 

be the characteristic polynomial of ~L and let cr^, be as defined in Q. 
Proposition 2. In Cj.— a^^, k — 0, . . . ,n. 

In view of Theorem |21 this proposition follows from the fact that c^, is equal to the sum 
of the kxk principal minors of L. In the case of undirected unweighted multigraphs, Propo- 
sition [3 is due to Kelmans [37] , who was probably the first to study the Laplacian 
characteristic polynomial (see also discussion in p. 42] and |^ Sections 1.2, 1.5], and 
[HI Theorem 7.5]); some extensions are given in the last statement on p. 236] and PUJ 
Theorem 2] . An alternative representation for the coefficients of the Laplacian characteristic 
polynomial can be found in |2(ij . 

Since Cj, = if and only if fc > n — d (fc = 0, 1, . . .), Proposition [2 implies 

Corollary 1. The multiplicity of as the eigenvalue of L is d. 
Another immediate consequence of Proposition |21 is 

Corollary 2. ctj, = A^, k = 0, . . . ,n, 

J: \ j\=k j£J 

where Aj^, . . . , A„ are the eigenvalues of L and J are the subsets of {1, . . . , n}. 

Chen ^1 p. 313, Problems 4.14 and 4.16] proposed an extension of the matrix-tree the- 
orem to additional minors of the Laplacian matrix and Chaiken jJOl gave a similar graph 
interpretation to all minors of L' . Moon |53| obtained a more general expansion which ap- 
plies to all minors of arbitrary matrices; Chaiken's theorem and a number of W.K. Chen's 
expansions follow from his result as special cases. Minoux [3] generalized Chaiken's theo- 
rem to semirings and Bapat et al. to mixed graphs (where each arc is either directed or 
undirected). Other useful graph interpretations of minors and determinants are given in |45| . 

We do not quote these results here, but we employ Chaiken's formulation ^01 of the all 
minors matrix tree theorem in the proof of a matrix-forest theorem in the following section. 
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4 Another matrix-forest theorem 



The foUowing theorem |13[ [T5] provides expressions for the forest matrices Q and J (see (O 
and IjlUll 'l in terms of the cofactors and the determinant of / + L, where / is the identity 
matrix. 

Theorem 3. Q = adj(/ + L) and a = det(/ + L). Thus, J ^ {I + L)"^ 
For the properties of (/ + L)-i, see [THl [1211301127]. 

It was mentioned in |15| that a quick way to prove the matrix-forest theorem is to employ 
the all minors matrix tree theorem, more specifically, to apply the first formula (without 
number) on page 328 in j^. Below we give a complete inference of Theorem O from the all 
minors matrix tree theorem. Note that a self-contained proof of the matrix-forest theorem 
for unweighted multigraphs can be found in |62j . Another inference based on some results 
of PniEZlESESI was given in ^3] for the case of weighted multidigraphs and multigraphs. 
Undirected and unweighted analogies of Theorem O have been presented in |46[ 14 7| (with the 
proof based on Chaiken's theorem) and . 

In the following proof of Theorem we employ a standard trick which enables one to 
reduce many novel statements about forests to known statements about trees or forests. 
Versions of this trick have been used in many papers, e.g., |l [Tni[ni[r7ll^l55ll51l55llI^ 
EZIEni-^ We formalize it by 

Definition 3. Let F be a weighted digraph. The digraph F with vertex set ^(F) — V{r) U 
{0}, arc set E{f) = E{T) U {{j, 0) : j £ ^(F)}, the weights of arcs in E{f) n £:(F) the same 
as for F, and w{{j, 0)) = 1, j G ^(r), will be called the ground extension of F.^ 

Observation 1. Let F be the ground extension of F. Let U = I + L(F), L = L(F). Then 
for any I,JC 1/(F), U{l \ j) = L{lU{0} \ JU{0}) holds. 

By virtue of Observation^ if one has expressions for all minors of the Laplacian matrices 
L (say, those provided by the all minors matrix tree theorem), then expressions for all minors 
of matrices I + L are got gratis. The following lemma establishes a correspondence between 
the forests in F and some forests in F. The lemma is formulated here in a form useful for 
expressing all minors of I + L. 

Lemma 1. Consider I = {ii, . . . C V{T), J = {ji, . . . ,jk} C ^(F), < k < n, and the 

set of in-forests J^^* r\( H in F. Then there exists a weight preserving one-to-one 

correspondence between this set and the set Txj in-forests F E j^^*^ fl ^ H in 
F such that the F 's consist of exactly k -\- 1 trees. 

Proof of Lemma^ Let F G jr^*nf D J^*"^*^"). To define the corresponding forest in 

\n=l / 

^ij' consider the replica F' of F in F and attach the arcs (r, 0) to it, where the r's are the 

^Note that one more expedient is to identify the roots of all trees in a forest, which converts the forest 
into a tree 1^ 1^ 1^ l?7l IMIIT^ . 
^In im r is called the cone of F. 
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roots oi F' that are not in J'. The resulting in- forest consists of exactly fc+l trees and belongs 
to T^j- Conversely, for any F e T^j, consider its restriction to V(r) as the corresponding 
forest of r. Obviously, this correspondence is one-to-one and the corresponding forests share 
the weight. □ 

Proof of Theorem |3j Consider the ground extension F of F. By Observation Q if 
U ^1 + L{T), U'^ is the entry of adj U, and L = L{f), then 



Let _^o^Y*°'*^*^ be the set of in-forests F e n P^*^ that consist of two trees. 

Denoting by inv{0 0,i —^j} the number of violations of nionotonicity in the two-element 
correspondence {0^0,i"S-j}, which is obviously zero, and using the all minors matrix tree 
theorem we get 



In the first passage, we used the fact that j:^^*^ = 0. 

Lemma m implies ?i;(jr°2^**' '*"**■') = w{T^^*^)^ so, from (|14|l and l|15(l . we get 

By Observation □ Theorem □ and Lemma □ ActU ^ det L({0} | {0}) = w{J^^^^*^) = 
w{T^*) = a (cf. 33, Eq. (37)] and |21 7.2 and 7.3]). This completes the proof. □ 

Remark 1. Obviously, the positivity of arc weights is needed for the last statement of 
Theorem |3 only; the first two statements are preserved for digraphs with arbitrary arc 
weights. 

Remark 2. Note that the cofactors and the determinant of / + L, in the case of an un- 
weighted undirected graph G, have been expressed in i2Sj in terms of spanning trees and 
2-forests in the ground extension of G (for the case of weighted graphs, cf. ^2 Theorem 2.3]). 
Ref. [211 also discusses the idea of using graph invariants related to [I + L)~^ in the study 
of the graph isomorphism problem. We surmise that the forest matrices Qj. also have some 
potential in this respect. 

It is easily seen that / -I- tL with t > arc nonsingular M-matrices, so their inverses are 
nonnegative. In the next section, the following parametric matrix-forest theorem pP will be 
helpful: 

Theorem EI. For any r G K, Q{t) — adj(/ -|- tL) and (j{t) = det(/ -I- tL). Thus, for any 
T > 0, J(r) = (/ + tL)-i. 

To prove this theorem, it suffices to apply Theorem^to the weighted digraph F'(t) that 
differs from F in the weights of arcs only: for all i, j = 1, . . . , n, w[j (r) — tw^^ . By Remark^ 
the nonnegativity of r is needed for the last statement of Theorem |3 only. 



= (-l)'+-'"det;7({j}| W) = (-l)'+-'"dctL({0,j}|{0,z}). 



(14) 




'''■^^■>w(i^) 



(15) 
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5 A method for calculating Qj^, . . . , 

We first show that Qi, . . . , Qn-d matrix coefficients in the polynomial expansion of 

adj(A/ + L). 

71 — d 

Proposition 3. adj(A/ + L) = ^ A""''"^ 

k=0 

Proof of Proposition |3j If A = 0, then the right-hand side is zero whenever d > 1 and it 
reduces to Qn-i when d — 1 (we put A° = 1). This is equal to adj(A/ + L) by Theorem^ 
For any A^O, letr = A^^. Using Theorem |2I we get 

n—d n—d 

adj(A/ + L) = adjA(/ + ri) = A"-1Q(t) =A"-i^Qfer''^ = ^Q^.A"-''-^ □ (16) 

fc=0 k=Q 

Proposition|21 underlies an easy algorithm for calculating Q^, . . . , Qn_^ and a^^ . . . , ct„_j; ■ 
Proposition 4. For any /c = 0, 1, . . . , 

Qk+i = i-L)Qk + a^+J, (17) 
o-fc+i = , , . ■ (18) 



Proof of Proposition |31 Since, by Proposition O Qq, . . . , (5„ are the matrix coefficients 
in the polynomial form of adj(A/ + L), where XI + L is the characteristic matrix of —L and, 
by Proposition 13 CTq, . . . , (7„ are the coefficients of the characteristic polynomial of —L, the 
equations (23 §3 of Chapt. 4] Qf.^i = o^k+i^ ~ ^Qk^ k = 0,1, . . . , take place. 

To prove (|18() . it suffices to take the traces on the left and on the right of (|17|l and use 
the fact that 

trQfc = (n- - fc)^^,. A; = 0,1,..., 

which holds since every in-forest with k arcs has n — k roots. □ 

Note that, by virtue of Propositions |21 and 13 the recurrent application of (|18|l and (|17fl 
starting with Qq — I coincides with the Leverrier-Faddeev algorithm |23l I7fj applied to 
calculate the characteristic polynomial of — L. 

Consider now a few corollaries to Proposition^ First, in what follows we will need a 
recurrence formula for the row stochastic matrices Jk- It is: 

Jk+i = ^i-L)Jk+I, fc = 0,...,n-d-l. (19) 

Second, the matrices LQk prevailing in Proposition 01 have a noteworthy graph interpre- 
tation. Let be the digraph of in-forests with k arcs of F, i.e., the digraph on vertex set 
V{Tf.) = V{T) whose matrix of arc weights results from Qfc by putting zeros on the main 
diagonal. In other words, {i,j) E £'(rj,) whenever j ^ i and q^j > 0; qfj is the weight of such 
arc. Evidently, F^ = F. 

Proposition 5. LQk is the Laplacian matrix of F^,^]^, A; = 0, 1, ... . 
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Proof of Proposition |SJ By Proposition^ LQk = cr^j^il — Qk+i' ^'^ ^^'^ off-diagonal 
entries of LQj^ coincide with those of L(rj,^]^). To complete the proof, note that every row 
sum of LQi^ is zero, since every row smu of both (Jf^^il and Q^^i is cr^.^-^ . □ 

Finally, Proposition^provides a recurrent formula for the Laplacian matrices Lj. :=L(rj,): 
We are going to discuss the application of digraphs Fj, to the analysis of F elsewhere. 

6 Forest matrices as polynomials in the Laplacian 
matrix 

It follows from Proposition^lthat the forest matrices Q^,, Q, and Q{t) are polynomials in L. 
As a corollary, the powers of L are linear combinations of Qg, . ■ • , Qn-d ■ 
First, it is straightforward to prove 

k 

Proposition 6. = ^ ^^.^(-L)', k ^ 0,1, 

These expressions are closely related to the characteristic polynomial of — L \i'6\i which, 
by Proposition 121 can be represented as <^{X) = {...{{(Tq A + cri)A + (J2)\ + . . . + <7^_{)\ + (t„ . 
To find (/3(A), one can successively calculate — a^, ^i{X) = A + (Tj^, — ("'o ^ + 

(T]^)A + (T2, . . . , f>n{^) — V'W- It is easily seen now that Qf. — ipi^{~L), k ^ 0, . . . ,n. 

Corollary 3. The matrices Qf,, k = 0,1,..., commute with all matrices with which L 
commutes, in particular, with L, Q{t), and each other. 

By Theorems and |3J , Q — adj(/ + L) and Q{t) = adj(/ + tL). Proposition (jSJ, and 
(|ll|l provide a polynomial form of Q and Q{t). 

Proposition 7. 

n — d 

Q = ^s„_,_fc(-i)' = adj(/ + L), 

n—d 

Q{r) = ^s„_,_,(r)(-rL)'' = adj(/ + rL), (20) 
fe=o 

where Sj and s^{t) are defined in Q and 

By adj(A/ + L) = A""1Q(t), where A ^ and r = 1/A. Combining this with (H^ 
and lO, we obtain 

n—d 

Corollary 4. adj(A/ + i) = ^ <.-d-kW {-L/\)\ 

fe=0 

where s';(A) — X]j=o '^j "'^^i i = Q, . . . ,n — d, and A 7^ 0. 

Corollary 2] and Proposition O can be considered as dual representations of adj(A/ + L). 
It follows from Proposition^lthat the powers of L are linear combinations of Qq, . . . , Q^_j^, 
but the coefficients are more complicated than before. 
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Proposition 8. For m = 0, 1, . . . , (— i)™ — ^ Qm-k holds, where = 1, 

E (-i)''''wrrn-fN fc = i.---,-, (21) 

are nonnegative integers, and all sums and products in , except for the first sum, range 
from i — I to k. 

A nice property of these linear combinations is that the coefficients a^, do not depend on 
m (similarly to Proposition EJ. For instance, 

= -(Qs -^1 Q2 -<^l)Qi -i<^3 -2^T2 ai +af)I), 

- (0-4 -2CT3 CTj -0-2 + 3(72 C^l - CTl )-f • 

Proof of Proposition |8j We first prove, by induction on m, the identity 

m 

{^Lr^Y.^'kQ^-k (22) 

fc=0 

with u'q — I and 

«fc= E n(-'^/5w)' fc=l,---:"i: (23) 

(/3(1),...,,3(«^)): i: /3W=fc 

where (3{i) are positive integers, is the variable number of entries in (/9(1), . . . ,/3(n^)), 
and the unmarked sum and product range from i = 1 to n^. 

For the basis of induction, observe that (— i)*^ = / = «[) Qq . Let (|22ll - (|23|) be valid for 
i-Lf, {-L)"'-\ By PropositionEl 

ni—l 

{~Lr^a[,Q„^-Y,a„,_,{~Ly. (24) 

1=0 

Substituting (|22|l in the right-hand side of ()24f) and interchanging the two sums we obtain: 



(-ir = a;,Q,„+E"rQ 

where 



(m) , 

7n — A; ' 

k=l 



v(™) 



ttfc -2^(,-cr.jai,_,, /e=i,...,m. 

It is easily seen that a^™^ = '^'fej fc = 1, . . . , m, thereby the induction step has succeeded. 

Next, for an arbitrary positive integer k, consider any vector (/?(1), . . . , /3(n^)) with posi- 
tive integer entries such that X)"^! /5(*) = ^ (see Let = \{i : (3{i) — j}\ , j = \, . . . , k. 
Classifying the set of vectors (/?(!), • ■ ■ , Pin^)) such that ^ I3{i) — k hy the equality of the 
corresponding vectors {pi, . . . ,p^,), we see that every such a class contains {J2Pi)^-/Y[{Pi-) 
members. This implies that a^. — aj,, k — 0,1, ... , (cf. (|21|l and 123)) and thus, completes 
the proof. 
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7 The matrix of maximum in-forests 

In this section, we study some properties of the normahzed matrix J ~ Jn-d maximum 
in-forests. Let /i^ [A) stand for the muhiphcity of A as the eigenvalue of a square matrix A. 

Proposition 9. (i) LJ = JL = LQ.^_^ = Q,^_^L = 0; 

(ii) J Jj, = J^.J — J , k — 0, . . . ,n ~ d; 

(iii) J is a projection: — J; 

(iv) rank J = J) = tr J = d; ^Iq{J) = n — d. 

Proof of Proposition|9l (i) Putting k — n — din p7|l and using the facts that Q„_j^^i = 
and o'„_d_|_i = 0, we get LQ^^_^ — 0. The other identities foUow from Corollary |31 and 

(ii) Multiplying H19|) by J and using item (i) and Corollary |31 we get the required state- 
ment, whose special case is (iii). 

(iv) Each maximum in-forest of F has d roots, hence trQjj_^ = da„-d and tr J = 
tr(CT^j';^Q^_^) = d. Since J is idempotent, rank J = fJ-iiJ) — tr J, so lJ,f){J) = n — d. □ 

The following connection between the spectra of L and L + aJ, a G C, will be used in 
the sequel. 

Proposition 10. (i) The spectrum ofL + aJ consists of all nonzero eigenvalues of L with 
their multiplicities and a with ^^{L + a J) — d. (ii) L + a J is nonsingular whenever a 7^ 0. 

Proof of Proposition 1101 (i) Let p{\) = cr~^^ J2i=o '^n-d-ii~'^y ■ Proposition 
J = a~^^Q^_j^ = p{L), so L + aJ ^ L + ap{L). Therefore, by [271 Theorem 3 in Chapt. 4], 
all eigenvalues of L + aJ are — Aj +ap(X^), where A,j, i = 1, . . . , n, are all eigenvalues of 
L with their multiplicities. By (i) of Proposition LJ = = Lp{L), whence Xp{X) is an 
annihilating polynomial for L. Therefore, for each A^, a nonzero eigenvalue of L, we have 
p(Aj) — 0, hence A^ — A^ . Otherwise, if Aj = 0, then A'^ = a, since p{0) = 1 by definition 
of p(A). Finally, by Corollary^ l^o{L) = d, thus /^^(i + aJ) — d. This implies (ii). □ 

Proposition 11. J= lim J(t) = lim {I + tL)~^. 



Proof of Proposition [TTl Using Theorem O and the definition 112|l of ./(r), we have 




n — d 




lim ( > 



.k — n — d 



') 



n-d^n-d 



= J. 
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8 L and J as "complementary" linear transformations 

For a complex matrix A, let TZ{A) and M{A) denote its range and null space, respectively. 
Recall that the index of a square matrix A, indA, is the smallest nonnegative integer k 
for which rank(yl'^+^) = rank(y4.'^). The eigenprojection^ at of A 57 or, for short, the 
eigenprojection of A 58 is the idempotent matrix B such that TZ{B) = J^{A'^) and M{B) = 
7?,(A'^), where v = indA. In other words, B is the projection on J\f{A^) along ']Z{A^). The 
eigenprojection is unique, because an idempotent matrix is uniquely determined by its range 
and null space (see, e.g., |S1 p. 50]).'' 

Since LJ = (Proposition IHI), we have n{L*) n 7^( J) = {0}, where L* = i^. Similarly, 
JL = imphes Ti{J*) mZ{L) = {0}. Consequently, by dH Theorem 11], L and J* are rank 
additive, i.e., rank(L + J*) = rankL + rank J*. Corollary ^ implies that rankL > n — d, 
whereas, by Proposition]^ rank J* = d. Since rank(L + J*) < n, we have ranki = n — d 
and rank(i + ,]*) = n. Now LJ = JL = imphes J\f{L) = n{J) and J\f{J) = n{L). 
Furthermore, by Proposition 1101 rank(L + J) — n, hence L and J are rank additive. It 
follows now from O Theorem 11] that n{L) n 7^(J) = {0}. Since 7e(J) = A/'(L), we get 
TliL) r\J\f{L) = {0}, which, by p. 165], implies indL = 1. The latter fact together 
with TZ{J) — M{L), Af{J) = 7?.(L), and J^ — J imply that J is the eigenprojection of L 
(alternatively, this follows from Proposition II II and ^48 . Theorem 3.1]). We proved 

Proposition 12. (i) L + J* is nonsingular. 

(ii) rank L = n ~ rank J = n — d. 

(iii) M{L) = 7^( J) and 7^(L) = N{J). 

(iv) n{L)r\n{j) = {o}. 

(v) indi = 1. 

(vi) J is the eigenprojection of L. 

It is known 57, p. 194], 1591 Theorem 7. a. 3] that for every finite homogeneous Markov 

k~l 

chain with a transition matrix P, the long run transition matrix P°° — lim ^ ^ P* is the 

eigenprojection of P at 1, which is the eigenprojection of / — P.^ On the other hand, I — P 
is exactly the Laplacian matrix L of the weighted digraph without loops whose arc weights 
are equal to the corresponding transition probabilities. Therefore J, the eigenprojection of 
L, coincides with P°°. The fact that P°° coincides with the normalized matrix of maximum 

■^The eigenprojections are also called principal idempotents 16(511321 . 

*Note that for every A £ C"X" g,t. indA = u and every idempotent matrix B, each of the following 
conditions is equivalent to B being the eigenprojection of A: 

(i) ■Ri.B) = MiA'^) and 7^(B*) = MC^*)") E|; 

(ii) A^'B = BA'' = and rank A" + rankS = n 1^7115^ . 

(iii) AB = BA and A + aB is nonsingular for all « 7^ 1411 (cf. (ii) of Proposition 1101 : 

(iv) AB = BA, A + aB is nonsingular for some a 0, and AB is nilpotent 1411 : 

(v) AB = BA, AB is nilpotent, a.nd AU = I - B = V A for some U,V € C™" EI]; 

(vi) B commutes with all matrices commuting with A, AB is nilpotent, and B ^ if A is singular I4UI : 
Moreover, the eigenprojection of A is 7 — AA^ , where A^ is the Drazin inverse of A (see Section 151. 

^This also follows from Meyer's Theorem 2.2 in 49 . Indeed, by this theorem, P°° =1 — [I — P){I — P)* , 
where {I — P)* is the group inverse of / — P, and the right-hand side is the eigenprojection of / — P, as 
mentioned in the next section. 
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in-forests of the digraph corresponding to a Markov chain is the so cahed Markov chain tree 
theorem 02 031 ■ Thus, item (vi) of Proposition 1121 provides an immediate proof of this 
theorem. 

By virtue of Proposition|51 every nonzero column of J (or Qn-d) is an eigenvector of L that 
corresponds to the zero eigenvalue. Moreover, it follows from M{L) — TZ{J) fProposition ll2|) 
that the nonzero columns of J span the null space of L. Since, by (|16|l . Q{t) is proportional 
to adj(A/ — {—L)) at A = r^^, Q{t) can be used to generate some eigenvectors of L that 
correspond to its nonzero eigenvalues. For completeness, we give a proof of this fact. 

Proposition 13. Let \ ^ be an eigenvalue of L. Then every nonzero column of Q{~\^^) 
is an eigenvector of L that corresponds to Aj . 

Proof of Proposition ESI Let X ^ X^I - L. Then detX = 0. Using TheoremOI and the 

fact that for every square matrix Y, Y adj Y = (det Y)I holds, we get 

(A,/ - L)Q{-X-^) = Xadj(/ - Xr^L) = A|-"XadjX = A,J-"(detX)/ = 0. 
This implies the desired statement. 

9 Forest matrices and generalized inverses of L 

The Moore-Penrose generalized inverse of a rectangular complex matrix A is the unique 
matrix X such that 

AX A = A, XAX = X, (AX)* = AX, (XA)* = XA. 

For an arbitrary square matrix A, its Drazin inverse, A^ , is the unique matrix X satis- 
fying the equations 

A''+^X = A'', XAX = X, AX = XA, 

where — mdA. If = 0, then A^ = A^^; if i/ < 1, then A^ is referred to as the group 
inverse, A*, i.e., the unique matrix X such that 

AX A = A, XAX ^X, AX ^ XA. 

As applied to the Laplacian matrices of graphs, the generalized inverses were considered in 
connection with the analysis of electrical networks (providing "resistance distance" ) , Markov 
chains, and some preference aggregation problems (more specifically, estimation from paired 
comparisons), in constructing geometrical representations of graphs (with applications to 
chemistry, social networks, etc.), in control, cluster analysis, and parallel computing. There 
is a huge literature on generalized inverses within the last years. For multiple representations 
of the Drazin inverse, see, e.g., [HHIEIEI- 

In this section, we present a few relations between the L* and the forest matrices and 
one representation for L+. In the case of symmetric L, where L* — some of these 
expressions are given in jl6|.^ 

°For symmetric L, interesting representations for L* = L"*" were proposed in EHI Theorem 2.2], and, 
in case of weighted trees, in 1391 and Theorem 3]. In 1221 Theorem 3] a combinatorial interpretation of 
the Campbell- Youla inverse (the symmetric generalized inverse with the zero diagonal) of L is given. 
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For an arbitrary square matrix A, AA^ is the unique projection on TZ{A'^) along J\f{A'^) 
p. 173]. Then / - AA^ is the projection on MiA") along TZiA"). Therefore, / - AA^ is 
the eigenprojection of A Combining this with items (v) and (iv) of Proposition^] 

we obtain 

Proposition 14. J = I — LL*. 

The fact that J is the eigenprojection of L helps interpret, in terms of in-forests, the 
expressions of generalized inverses of L that involve the eigenprojection of L. 

Proposition 15. 

(i) For any a ^ 0, L* = {L + a J)~^ — a^^ J, whence L* — lim {L + a J)~^ ■ 

\a\ — >oo 

For any a^O, L* = {L + a J)-\l - J). 

(iii) L* = (j„_,_i - j) . 

(iv) L* = hm T f J(r) - J] . 

Remarks on Proposition [T51 (i), (iii), and (iv) were presented in [2]. (i) results by 
substituting J for the eigenprojection in the expression of group inverse employed in j5()l 
p. 150] (for its proof see |6U1 Theorem 4.2]; related expressions appeared in ^W", Theorem 5.5] 
and |58l last line on p. 646], where '+' must be replaced by ' — ')■ (ii) is obtained by the 
same substitution in the representation of Drazin inverse given in |4(Jj (the case with a = 1 
appeared in [SH]) or by multiplying (i) by LL* — I ~ J. In view of Propositions El and 01 
(iii) follows from the expression of Drazin inverse discovered independently by Hartwig [IV2\ 
Eq. (13)] and Gower Theorem 1]. 

The matrices L + aJ are the "complementary perturbations" ISO] of L. Matrices of this 
kind are important for the analysis of M-matrices and singular systems of equations. In 
particular, a matrix A with eigenprojection B and nonpositive off-diagonal entries is an M- 
matrix if and only if for some c > 0, (A + aB)~^ is nonnegative when a £ (0, c) IHOI- If A 
is an M-matrix, then {A + a_B)~^, a G (0, c), make up a class of nonnegative nonsingular 
commuting weak inverses for A |50j . {L + oiJ)~^ can be represented as a linear combination 
of forest matrices using (i) and (iii) of Proposition El 

(L + aJ)-^ = ^^^^ + /? j) , 

where /3 = ag"~d i ^ ^' This throws some light on the nonnegativity of (L + aJ)^^: if 
a e (0, ^ ) then (L + aJ)~^ is a positive combination of Jn-d-i and J. Based on 
this, we termed (L + aJ)~^ the matrices of dense in-forests of F. These and the inverse 
"uniform diagonal perturbations" {L+aI)~^ can serve to measure proximity between digraph 
vertices |2]. Note in this connection that by |6()l Corollary 4.4], {L + aJ)~^^ > for all a > 
sufficiently small if and only if vertex j is accessible from i in F, and the same is true for 
{L + al)-^. By TheorcmjSl, {L + al)-^ is proportional to J(t) with r = 1/a. 

We conclude with one expression for the Moore-Penrose inverse of L. 
Consider the matrix Z := L + J* which is nonsingular by Proposition ^1 Using the 
identity LJ^O (Proposition O, we get (Z*y^Z-^ = (ZZ*)-^ = {J*J+LL*)-\ 
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Proposition 16 Y. L+ = L*{ZZ*)~'^ = L* {J*J +LL*)-^ . 



One method to prove this is to check the conditions in the definition of Moore-Penrose 
inverse by direct computation using Proposition |3 and the facts that {ZZ*) ^ commutes 
with LL* and J*J and that LL*{ZZ*) ^ and J*J (ZZ*)^^ are symmetric Alternatively, 
Proposition^] can be proved by employing the Penrose formula — A* {AA*)~^ , the fact 
that {AA*)+ = (AA*)* (since A A* is Hermitian) and an expression of (AA*)* such as those 
given in (i) and (ii) of Proposition [TKl 

10 A concluding remark 

It is instructive to compare the "Laplacian graph mathematics" we touched upon in this 
paper with the corresponding results on the adjacency characteristic matrix, see, e.g., |21l 
Sections 1.4, 1.9.1, 1.9.5 and others] and the articles by Kasteleyn and Ponstein cited therein, 
|f)lj , and so on. This comparison suggests that the Laplacian mathematics is based on trees 
in the same sense as the "adjacency graph mathematics" is based on routes and circuits. 
We mean that a number of expressions related with the adjacency characteristic matrix can 
be interpreted in terms of routes and circuits, whereas the counterparts of these expressions 
related with the Laplacian characteristic matrix involve spanning forests for their interpre- 
tation. 
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